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(57) Abstract 

A method and apparatus for information labeling and control includes central station (10) equipment which combines a program 
signal with content labels which separately and continuously identify the audio, video, and data content of the program signal, and viewer 
station (20) equipment which generates a local content label identifying program material which is acceptable to the user. By comparing 
the two labels the user station equipment can block or substitute alternative audio, video, or data for offensive portions of a program signal 
received through a transmission or stored for playback on various media such as video tapes, audio tapes, CDs, computer disks, optical 
storage media, and video cartridges. 
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METHOD AND APPARATUS FOR INFORMATION 
LABELING AND CONTROL 

BACKGROUND 

5 The present invention relates generally to information processing and more 

particularly to a system and method for information labeling and control in which a 
user can control access to information based on its content. 

The rapid growth of the communications industry has brought about significant 
changes in society. The instantaneous access to couqtie^^infonnatipn sources 

10 through television networks, home video, computers, and communication networks 
raises significant social, philosophical, ethical, legal, technical, and competitive 
issues. For example, a large number of TV programs which are easily available to 
the public are considered by many people to be harmful or offensive to them or their 
children. This is also true of certain information available on public computer 

15 networks. And while information providers enjoy a large degree of freedom in 
distributing their products, the only protection users who receive such information 
have is their right to turn it off or not turn it on. With such a large amount and wide 
variety of programs and information available, even these alternatives are more 
difficult than they first appear. These simple choices are not the only possible 

20 alternatives, and may not be acceptable alternatives, unless consumers of information 

can make informed decisions. ..,;w'"..^^- s--' 

. Labels have often been provided to aUow users to understand the nature and 

content of products prior to their use. Food and cigarettes, for example, are often 

labeled to allow users to make informed choices without the need to first use the 
25 product. Medicines are not only labeled, they are often fitted with etuld-proof caps. 

This allows parents to make informed decisions and provides a means to help parents 

prevent unauthorized use by their children. 

Until recently, information available to the general public has; not presented a 

significant threat to users. For example, access to harmful or objectionable 
30 information through television networks has been relatively limited until recently. 
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With the rapid growth of the communications industry, however, potentially harmful 
and/or offensive information is much more widely available. 

Unlike the food and medicine industries, the communications industry has 
provided few means of labeling or restricting access to its products, due in part to the 

S policy of favoring free speech. One such method, however, is described in U.S. 
Patent No. 4,528,529, entitled "Method and System for Subscription Television 
Billing and Access." In this system, a transmitted television program signal includes 
a code which identifies the category in which the program has been rated. The 
television system at home allows the user to set parameters which define an acceptable 

10 rating of programs for home viewing. Based on a comparison of the two settings, the 
system either denies or allows access to the program. 

While the above system provides one method of restricting access to television 
programs containing offensive material, many other alternatives are possible to 
provide users with enhanced control over access to information. 

is ' ' - v " "<"~" : v ' 1 ^ " : - ' : - v 

SUMMARY 

It is an object of the invention, therefore, to provide a method and apparatus 
for information labeling and control in which a user can control access to information 
based on its content. 

20 It is a further object of the invention to provide a method and apparatus for 

information labeling and control so that a user can avoid access to portions of a 
program, film, file, CD-ROM, World Wide Web ("WWW*) jiage etc., which are 
offensive or undesirable to the user, or in the case of a parent, the parent can prevent 
access to the information by children. 

25 It is a further object of the invention to provide a method and apparatus for 

separately and continuously labeling and controlling audio, video, and data signals. 
According to one embodiment of the invention, the audio and video of television 
programs can be independently evaluated and separate content rating labels can be 
provided for each. The content rating label may change dynamically to reflect the 

30 changing content of the program. A control mechanism at the user site continuously 
compares the user setting with the transmitted content rating label and blocks the 
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audio or video whenever the transmitted content rating label exceeds the limit set by 
the user. 

It is a further object of the invention to provide a method and apparatus for 
information labeling and control in which a substitute progrzun signal is presented to a 
5 user instead of the offensive or undesirable portions of a program. 

An exemplary apparatus for information labeling and control comprises first 
means for receiving a program signal and a program information label, second means 
for generating a local information label which is related to the program information 
label, and third means for blocking portions of the program signal based on the 
10 program information label and the local information label. The apparatus may also 
comprise means for generating the program information labels and means for 
providing a substitute program signal when the regular program signal is blocked. 

An exemplary method for information labeling and control comprises the steps 
of receiving a plurality of information units comprising a program signal, receiving a 
15 plurality of program information labels, each program information label being 
associated with a content of one of the information units, generating a local 
information label associated with a content of the program signal, and allowing or 
denying access to the information units based on the information labels and the local 
information label. 

20 The present invention thus provides several advantages to information 

producers and users. By continuously and dynamically electronically labeling 
programs and providing a means for users to enter their requirements, users gain by 
being able to make informed choices, producers and distributors gain by having a 
greater opportunity to provide what customers want, and, society gains by maintaining 

25 freedom of choice and supporting informed decisions. 

The present invention may be implemented in any environment in which a 
program signal is presented to a user, for example in a broadcast, cable, or satellite 
television system, on home video cassettes, compact discs, video discs, audio tapes, 
computer discs, video game cartridges, electronic books, Internet World Wide Web 

30 pages, computer networks, and other multimedia or communication systems. The 
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system and method of the present invention may be built into new systems, integrated 
into existing systems, or provided by an external stand-alone unit. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 The foregoing and other objects, features and advantages of die present 

invention will be more readily understood upon reading the following detailed 
description in conjunction with the drawings in which: 

Figure 1 is i functional block diagram of an exemplary apparatus for 
information labeling and control; 
10 Figure 2 is a functional block diagram of the central station equipment of 

Figure 1 according to an exemplary embodiment of the 
invention; ' :: 
Figtire 3 is a diagram of an exemplary information format for a 
' ' " transmitted infonnation label 
15 Figure 4 ; " is a signal diagram illustrating ah exemplary form of the video 

portion of the program signal with program labels as utilized in 
the system of Figure 1; 
Figure 5 is an exemplary analog version of the viewer station equipment 
shown in Figure 1; 

20 Figure 6 is an exemplary digital version of the viewer station equipment 

shown in Figure 1; 

Figure 7 is ah exemplary embodiment of the viewing control unit shown 
in Figure 1; 

Figure 8 is ah exemplary embodiment of the label interpretation unit 
25 shown in Figurb 1; 

Figure 9 is an exemplary analog version of the access control unit shown 
in Figure 1 ; 

Figure 10 is an exemplary digital version of the access control unit shown 
in Figure 1; 

30 Figure 11 is an exemplairy embodiment of the frame storing unit shown in 

Figures 9 and 10; 
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Figure 12 is a diagram of a method for the transmission of substitute audio 

signals in an analog environment; 
Figure 13 is an exemplary apparatus for the transmission of substitute 

audio signals; and 

5 Figure 14 is a diagram showing a substitute vi^eq stream which provides 

substitute signals for program video streams A and B. 

DETAILED DESCRIPTION 

Referring now to Figure 1, an exemplary information labeling and control 

10 apparatus adapted for television viewing will be described. It should be understood 
that application of the present invention is not limited to television systems, and that it 
may be applied to any system of communication in which information is delivered to a 
user. In an exemplary embodiment for television, the apparatus comprises central 
station equipment 10 which supplies program signals to viewer station equipment 20 
, 15 at each of the viewer stations. As will be described hereinafter in greater detail, the 
program signal includes audio and video signals as well as various synchronizing 
signals and labels. The audio and video signals can be generated from a conventional 
source such as television camera equipment. The program signal is supplied to the 
viewers either by conventional broadcast or cable techniques and can be transmitted 

20 with a suitable conventional transmitter, The program signal can be either scrambled 
(e.g., encrypted) or not scrambled (in the clear), and can be an analog signal, such as 
in die NTSC, PAL, or SECAM format, or a digital signal. 

As shown in Figure 1, the central station equipment 10 may include a program 
labeling station 30 for generating or receiving the program v sigi>als and for generating 

25 the various synchronizing signals and labels, a storage unit 40 for storing the program 
signal after the labels have been generated and combined with the program signal, and 
a modulator and transmitter 50 for transmitting the program signal to the viewer 
station equipment 20. The viewer station equipment 20 may include a tuner 60 or 
program selector 70 for receiving the program signal, a demodulator 80 and/or 

30 decoder 90 for demodulating and decoding the received program signal, a viewing 
control unit 100 which allows a viewer to control access to the received program 
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signal by generating various local labels, a label interpretation unit 110 which 
evaluates and compares the locally generated and transmitted labels, an access control 
unit 120 which controls access to the program signal, and a modulator 130 for 
modulating the access controlled program signal onto a suitable carrier frequency 

5 prior to transmission to the TV antenna input. 

Although Figure i shows a system in which the program signals and labels are 
transmitted to the viewer station equipment 20 by the modulator/transmitter 50, those 
skilled in the art will recognize that the present invention may be utilized in a system 
in which the central station functions to combine the program signals with the labels 

10 and to store the combined signal on a local storage device such as a compact disc, 
video disc, computer disc, audio tape, video tape, or video game cartridge. In such 
system, the user would receive the program signals and labels from the local storage 
device rather than from the modulator transmitter 50 of the central station equipment 

15 The central station equipment 10 is shown in greater detail in Figure 2. As 

shown, ah exemplary program labeling station 30 includes a program" material source 
140 which can be any conventional generator of thie audio and video program signals. 
A substitute source generator 150 may also be included for generating substitute audio 
or video program signals, for example to provide substitute signals during offensive 

20 or undesired portions of the program signal. 

A label editor 160, which includes an information label generator 170 can be 
provided to generate a variety of labels or codes for labeling the program signals. 
The label editor 160 may comprise a video screen and a speaker for presenting to a 
viewer/editor the program signals received through transmission lines 185 from the 

25 program material source 140. The viewer/editor views the program signals and can 
command the label editor 160 to generate appropriate labels with the information label 
generator 170, for example according to the instantaneous content of the program 
signals. The label editor 160 may also comprise a mask code generator 180 for 
generating a mask code which is transmitted with the program signals for masking an 

30 offensive or undesirable portion of the video signal. A character generator 190 may 
optionally be provided to generate characters to be transmitted to the viewer station 
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equipment 20 for display in accordance with a command signal sent by the label 
editor 160. 

According to an exemplary embodiment of the invention, the information label 
generator 170, synchronized with the video signal, provides a transmitted information 
5 label TIL for transmission with the program signals.. The transmitted information 
. label TIL may be used to identify and characterize the content of the audio and video 
program signals. The TEL may be inserted intp th^ ( video, iriformation stream, for 
example in the vertical retrace interval or at any other convenient location in an 
analog transmission. In a digital transmission, the TIL information can be inserted 

10 into the encoded information stream at any appropriate location. Depending on the 
amount of information contained in the TIL, the TIL may be inserted in an analog or 
digital video stream, for example on one or more lines,, if necessary. Alternately, the 
TIL can be split over a number of frames. , . s . 

A synchronization unit 200 controls the state of the program material source 

IS 140, the substitute source 150, and the character generator 190 so that the 

viewer/editor using the label editor 160 can control, e.g*, stop, slow,, or reverse, the 
program signals in order to facilitate the generation of the labels at the appropriate 
places in the program signal. The synchronization unit 200 also detects the 
appropriate synchronization pulse in the video signal, e.g., the vertical sync pulses 

20 during the vertical retrace interval, and supplies the sync pulse to the label editor 160 
in order to allow the information label generator 170 to insert the transmitted 
information label TIL in the correct place in the video stream. 

The information label generator 170 receives the sync signal from the 
synchronization unit 200 and generates the transmitted information labeL TIL, for 

25 example during the vertical retrace interval. If the present invention is implemented 
with a digital signal, the TIL may be inserted into any appropriate location in the 
digital video stream. The TIL is preferably transmitted on : the : same carrier frequency 
or channel as the video signal ("in band"), but may also be transmitted on a different 
channel or frequency ("out of band"). 

30 Figure 3 shows a diagram of an exemplary information format for a 

transmitted information label TIL which may include a suitable allocation for a 
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synchronization header 210, general information labels 220, frame specific 
information labels 230, and a checksum 250. The transmitted information label TIL 
is preferably a digital code with a designated number of bits for each field within the 
structure; however, it will be understood that any well known coding technique, such 
5 as the tone burst technique described in U.S. Patent No. 3,824,332, entitled "Pay 
Television System", which is hereby incorporated by reference, may be utilized. 
Although the embodiment of the TIL shown in Figure 3 contains both general 
information labels 220 and frame specific information labels 230, other embodiments 
of the invention may contain-either frame specific information labels or general 

10 information labels, but need not contain both. 

The synchronization header 210 is provided to synchronize the TIL with a 
conventional data receiver 85 in the demodulator 80. The general information labels 
■■■ 220 contain information on the overall program signal. The frame specific 
information labels 230 may comprise labels which rate the instantaneous content of a 

15 frame of information. The checksum 250 may be a conventional 16 bit cyclic 
redundancy check for error checking: 

The fields within the transmitted information label TIL may include any 
desired codes for labeling and controlling the program signals transmitted to the . 
viewer station equipment 20. According to one embodiment, the transmitted 

20 information label TIL contains frame specific information labels 230 comprising an 
audio category label and a video category label which rate the content of the audio 
and video program signals in a particular frame. The audio and video category labels 
can each comprise one or more bits, and preferably comprise three or more bits so 
that each category label can define several levels or values of program content. The 

25 audio and video category labels can thus provide an instantaneous label of the content 
of the audio and video program signals in a television program. For example, the 
values 1 through 4 of the video category label can represent that the video signal is 
rated "G," "PG," "R," or "NC-17" at a particular point in time during the program: 
1: Suitable for viewing by the public in general ("G"); 

30 2: Subject matter requiring parental guidance ("PG"); 

3: Restricted subject matter ("R"); and 
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4: NC-17-rated material ("NC-17".).- 

A viewer/editor, using the label editor 160, can generate audio and* video 
category labels which independently identify the instantaneous content of the audio 
and video signals. The category labels can be configured to accommodate additional 

5 or alternative values, such as W PG-1 3 for example, ^ r Xl 

< A number of additional category labels may be allocated to more specifically 
label the content of the audio and video signal^ Table 1 provides an. example of the 
structure of an exemplary transmitted information label TIL which includes both 
general information labels 220 and frame specific information labels 230. The 

10 general information labels 220 contain, information on the overall content of die 
program signals, as will be described below in greater detail. .The frame specific 
information labels 230, as shown in the frame specific information labels portion of 
Table 1, may include a synchronization header, a frame rating label which rates the 
overall content of an individual frame, a frame theme label which categorizes the 

IS frame as haying a particular theme such as comedy, tragedy, news, love story, 

adventure, etc., and labels which individually rate a level of violence content, sexual 
content, and/or foul language content of the audio and video signals of a particular 
frame of the program signal. The terms sex and violence are used in their broadest 
definition. They relate to all sexual or violent acts or allusions whether they be 

20 physical, emotional, psychological, intellectual, or racial. 

Table 2 shows an example of the content of the transmitted information label 
TIL according to the structure shown in Figure 1. In the frame specific information 
labels in Table 2, a frame rating label of 0/ (Unrestricted) is shown as well as a frame 
theme label specifying that the program is a news program.. A video sexual content 

25 label is allocated to label a sexual content rating of the video signal from VS-0 to VS- 
7 (VS-7 signifying most sexually explicit, for example), and an audio sexual content 
label is allocated to label a sexual content rating of the audio signal from AS-0 to AS* 
7. Analogous audio and video violence content labels are provided, as well as a foul 
language content label for rating the instantaneous content of the dialog in a program 

30 from L-0 through L-7. 
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Table 1 



Example Transmitted Information Label 
Structure 


Size 


Comments 


GENERAL INFORMATION LABELS 






Sync 




16 


Synchronization Header 


Name "'/L^^^- 




320 


Text field containing name 


ID _ \ t : 


- - ■ 


64 


- Identification number 


Rating, 




4 


Overall rating of 
Information 


Theme 


, ...... 


so 


Text field describing 
Theme of Information 
e.g. News 


Description Text 

- - 




320 


Text Field containing 
descriptive text. This may 

chancre with Hrnp -- 


Rating Profile 






Obtained from aptrrpaat** 

of frame labels 


% Sexual Content 






Structure describing 
percentage of level of 
sexual content of 
information 




level U 


4 


No sexual content 




level 1 


4 


Innuendo 




level 2 


4 


Partial Nudity 




level 3 


4 


Full frontal Nudity 




level 4 


4 


Explicit 


% Violent Content 






Structure describing 
percentage of level of 
violent content of 
information 




level 0 


4 


No violent content 




level 1 


4 
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25 





level 2 


4 






level 3 


4 






level 4 


4 


very violent content 


%Foul Language 

... - . . - . 


■ ■ - - • ■■ 


- - » -• ■ 


Structure describing 
percentage of level of bad 
language and sound 
content or lnrormauon 


r .... - , 


1CVCX VF 


*r * 


no ioui language 




level 1 


... 

*T 






level 2 


4 






level 3 


4 






level 4 


4 


very foul language 


Checksum 




16 




Total General Information Label Size 


880 




FRAME SPECIFIC INFORMATION 
LABELS 




*--* *■'•* * ■•■ ■ ■ r *- *■ - 1 


Sync 




16 , 


Synchronization Header 


Frame Rating 




4 


Rating of Individual frame 


Frame Theme 




80 


Theme for Frame 
e.g. Comedy 


Video Sexual 
Content level 




3 


Sexual content level of 
frame 


Audio Sexual 
Content level 






Sexual content level audio 
within frame 


Video Violent 
Content level 




.3 


Violent content level of 
frame 


Audio Violent 
Content Level 




3 


Violent content level audio 
within frame 


Foul Language 
Content level 




3 


Foul Language content 
level of frame 
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5 



Auiuo aoo viaeo 
Access Processing 
Instructions 






Instruction opcodes to 
provide information on 
how to process frames 
which exceed the LJL. 


Video Opcode 




48 


Instructional Opcode for 
processing of video signals 


parameters 






parameters associated with 


Audio Opcode 




32 


Instructional Opcode for 
processing of audio sienals 


parameters 






parameters associated with 
Opcode 


Padding 




9 




Checksum 




16 




Total Frame Label 
Size 




220 





WO 97/23996 



PCT/US96/20077 



-13- 



Table2 



Example Transmitted Information 

JLaDei 






. OKiNJliKAl^ UNI* UKMA I 1UIN 
T AltlM «S 


, ......... • 




%yyii%*^ „ . , „ « . - t . — 




101010101010101 


Name 




The News Tonight 


ID 




12345678 


Rating 




2 (PG) 


Theme 




- news 


Text 




Dissent in Congress 


Rating Profile 






% Sexual Content 








level 0; No sexual 
content 


16 




level 1; Innuendo 


0 




level 2; Partial 
Nudity 


0 




level 3; Full 
frontal Nudity 


0 




level 4; Explicit 


0 


% Violent Content 








level 0 


15 




level 1 


1 




level 2 


0 




level 3 


0 




level 4 


0 
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% Foul Language 


level 0 


14 




level 1 


. ■ l 




1*»v*»1 0 
IwVCl Z, 


i 






u 


, •. - . : . • 


1CVC1 *r 


u 


Checksum 




1A11 Aim AA1A 

1U11 U1U1 UUIU 

oi ir 


FRAME SPECIFIC 
INFORMATION LABELS 




■ 


Sync 




101010101010101 


Frame Rating 




©(Unrestricted) 


Frame Theme 




news 


Video Sexual Content level 




0 


Audio Sexual Content level 




0 


Video Violent Content level 




0 


Audio Violent Content level 






Language Content level 




i 
i 


Audio and Video Access 
Processing Instructions 






Video Opcode 




Mask 


parameters 




25,100 -330,400 


Audio Opcode 




bleep from line 
x to y 


parameters 




10, 525 


Padding 




0000 0000 0000 


Checksum 




0101 1101 0000 
0101 
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As will be appreciated by those skilled in the art, any other desired frame 
specific information labels may be included in the transmitted information label TIL in 
accordance with the needs of the user. For example, "How To" programs can be 
labeled with descriptive text as being appropriate for expert or novice users, so that 

5 the user can be informed of and control the level of sophistication of the program. 
Programs that teach values to children can be labeled with descriptive text as to which 
value is being promoted so that paints can control an want their 

children to believe in. In other embodiments of the invention in which the program 
signal comprises a data signal, the TIL may include a data category label to 

10 characterize the content of the data. 

Tables 1 and 2 also show that the frame specific information labels in the TIL 
preferably contain audio and video access processing instructions which comprise 
various codes for instructing the access control unit 120 in the viewer, station 
equipment 20 as to how to process the incoming signals. ~ For example, the audio and 

15 video access processing instructions may instruct the ac^ to mask 

certain portions of the video signal or *bleep dut"' certain portions of the audio signal 
when the video category label or the audio category label are greater than the user 
desires. As shown in Tables 1 and 2, the audio and video access processing 
instructions may contain a video "opcode" or instruction code with video parameters 

20 and an audio opcode with audio parameters. The video opcode may contain, for 
example, a suitable code which instructs the access control unit 120 in the viewer 
station equipment 20 to mask certain portions of a video frame when the video signal 
is offensive. The video parameters provide the shape and coordinates of the mask for 
a particular frame. The audio opcode may contain a code which instructs the access 

25 control unit 120 in the viewer station equipment 20 to "bleep out" the audio signal for 
a certain duration when the audio signal is unacceptable. The audio parameters 
provide the start and end points of the substitute "bleep" signal. Other examples of 
video opcodes are as follows: 

RectMask x,y u,v rectangular mask with start co-ordinates x,y and stop co- 
30 ordinates u,v 
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BlurMask x,y u,v rectangular blurring mask with start co-ordinates x,y and stop 

co-ordinates u,v 

CircleMask x,y,r. Circular mask with center co-ordinates x,y and radius r pixels 
Freeze frame Display previous frame 

S Substitute ch,n Switch to substitute information stream on channel ch for next 

. . frame, switch back after the nth fnune. This may be time or 
„ frequency division multiplexed. ... : s t % t . ^ 

Other examples of audio opcodes are as follows: 

Bleep x,f,n Switch to tone generator with frequency f , at line x, for n lines 

10 Substitute ch,x,n Substitute audio from channel ch at line x for n lines, where ch 

may be a virtual channel number which identifies the location of 
the substitute audio stream. 
The general information labels 220 of the transmitted information label TIL 
will now be described. As shown in the general information portion of Tables 1 and 

15 2, exemplary general information labels 220 may include a synchronization header, a 
name label comprising a text field containing a name of the program, (e.g. "The 
News Tonight"), a program ID label for uniquely identifying the program, a rating 
label which contains an overall rating of the information or program, (e.g. "PG"), a 
theme label comprising a text field describing a theme of the overall information or 

20 program such as news, comedy, tragedy, etc., a textual label which may be used for 
transmitting descriptive text with the program signals, and rating profile labels. As 
will be appreciated by those skilled in the art, many of the labels mentioned above 
may be utilized both in the frame specific information labels 230 and the general 
information labels 220. 

25 The rating profile labels can be provided to assist the user in determining 

whether to view a particular program. The rating profile labels, as shown in Tables 1 
and 2, may contain data relating to the percentage of time during the program that the 
program signal contains different levels of sexual material, violent material, or foul 
language. This data may be obtained, for example, by totaling the amount of time 
30 during a program that the frame specific information labels for each category (e.g. 
audio violence, video violence, audio sexual content, video sexual content, foul 
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language) are rated at each level (e.g. levels 0-4). The rating profile labels may 
contain data, for example, which indicate that for 25 percent of the program, the 
audio signal is rated at level 2 for foul language or that for 20 percent of the 
program, the video signal is rated at level 3 for sexual content. 

5 The rating profile labels may also contain data which characterize the content 

of the overall program signal, without distinguishing between audio and video. As 
shown in Tables 1 and 2, the rating profile labels may indicate the percentage of time 
that the overall program signal (e)g;; Either the audio signal, video signal, or both) is 
rated at each level (e.g. 0-4) for each category (e.g. sexual content, violence, foul 

10 language). 

The rating profile labels may also contain data relating to the percentage of 
time during the program that the overall program signal or an individual audio or 
video signal is rated at each conventional rating such as "G*, *PG W , "R", or *NC- 
17". For example, the rating profile labels may indicate that a video signal for a 

15 program is rated *G" for 75 percent 6f tlie progim/*^ 23 percent of the 
program, *R tt for 2 percent of the program, and "NC-17* for none of the program. 
This data would indicate, therefore, that if the portions of the video signal rated above 
n PG", which would be translated to a rating profile label, were" blocked^ the program 
could be viewed without significant interruptions (2%), but that if portions of the 

20 video signal rated above W G" were blocked, the viewer would experience significant 
interruptions (25%). 

The viewer station equipment 20 preferably includes a character generator (see 
Figures 9 and 10) in the access control unit 120 which generates characters to display 
on the viewer's screen a table of the information contained in the rating profile, as 

25 well as any information contained in the other transmitted category labels in the TIL, 
if desired. This advantageous feature allows a user to make informed viewing 
decisions based on the transmitted information labels. For example, the user can 
estimate the amount of offensive material contained in a program as well as the 
amount of time that a program signal would be blocked. 

30 As described above, the transmitted information label TIL may include a 

suitable number of bits in the general information labels 220 allocated for "description 
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text" which contains a textual description relating to the program signals, such as a 
textual description of the content of the audio and video signals. The description text 
may be displayed by a character generator in the viewer station equipment 20 to 
display, for example, a textual description of the violent scenes in a film, or reasons 

5 why the film was rated as "NC-17" during certain portions. Or, the description text 
may contain a message that certain portions of the program have been rated M R" due 
to obscene language, but not obscene video. Such information thus allows the user to 
make an informed decision as to whether to view a program without first being 
exposed to the program. 

10 According to a further embodiment of the invention, the description text may 

also contain information on consumer products shown or described in the program 
signal. For example, the source of products or services; shown in a program can be 
transmitted in the description text and displayed on the viewer's screen, in this way, 
when a viewer sees or hears about a product he or she likes in a program, the viewer 

IS can obtain information on how to purchase the product through the display of the 
description text on the viewer screen. Clothing, appliances, and musical recordings 
are examples of products for which a viewer can obtain purchasing information. 
According to this embodiment, the description text may include a phone number, a 
price, or any other desired information on the product or service which enables a 

20 viewer to purchase the product. 

The description text can be adapted to transmit many other types of textual 
information. For example, when the program is a sporting event, the description text 
may be adapted to display on the viewer's screen the statistics of a team or particular 
player. 

25 The program ID label shown in the general information portion of Table 1 can 

be added in the central station equipment 10 to identify a program for billing 
purposes, as described in U.S. Patent No. 4,528,589, entitled "Method and System 
for Subscription Television Billing and Access", which is hereby incorporated by 
reference. The program ID label can comprise any suitable number of bits which 

30 would enable the program to be uniquely identified. If scrambling is implemented, a 
scramble code may be provided by a scramble code generator in the central station 
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equipment 10 along with the transmitted information label TIL for transmission with 
the program signal. If the program signals are scrambled prior to transmission, the 
scramble code can be combined with the transmitted information label TIL and the 
program video signal, as is described in the above referenced U.S. Patent No. 
5 4,528,589. 

An advantage of providing the viewer with the capability of displaying the 
labels in the TIL on the viewer's screen is that the viewer will ieam how various 
types of programs are labeled. With the character generator in the access control unit 
120, any of the various labels described above can be displayed so that the viewer can 

10 view the labels as the program is being viewed. In this way, the viewer will become 
familiar with the types of program material which is rated at a particular level such as 
w PG n or *k tt , or which is characterized as a comedy or as an expert "How To" 
program. The audio and video access processing instructions may contain a 
designated number of bits which instruct the access control unit 120 to display the 

15 transmitted labels on the viewer screen as they are received if commanded by the 
viewer/ 

deferring again to Figure 2, the program signal, the transmitted information 
label TIL, and any other labels and substitute program signals are supplied to a signal 
combiner 260. In an NTSC, PAL, or SEC AM transmission, for example, the signal 

20 combiner 260 receives the program signals and label signals and combines these 

signals in a conventional manner to produce a signal such as that illustrated in Figure 
4. As shown in Figure 4, the successive horizontal lines of an analog video signal are 
conventionally separated by horizontal synchronization pulses, and each frame of the 
video signal is separated by a vertical retrace interval or vertical synchronization 

25 signal. During the vertical retrace interval, various equalizing and synchronization 

pulses are provided, and it is in this interval that the transmitted information label TIL 
and other labels are preferably combined with the transmitted information signal. 
These labels are preferably encoded in a digital form as illustrated in Figure 4 
although any well known coding technique, such as the tone burst technique described 

30 in U.S. Pat. No. 3,824,332, may be utilized. Each program that is transmitted may 
thus be identified, characterized, and described by placing the transmitted information 



WO 97/23996 



PCT7US96/20077 



-20- 

label TIL and other labels in the video signal during the vertical retrace interval, for 
example, or, if implemented in a digital system, at any convenient location in the 
digital video stream. 

The combined signal is then transmitted to a storage unit 40, such as a VCR, 
5 which stores the combined signal so that copies of the program can be made which 
include the various labels and access processing instructions generated with the label 
editor 160. Copies of the program can be stored on conventional media such as a 
compact disc, video disc, audio tape, video tape, Video game cartridge, etc. and 
distributed to users. In a television system, the combined signal is applied to the 
10 modulator and transmitter 50 for modulation onto a suitable carrier wave for either 
broadcast of cable transmission, for example. 

The program signal as well as any substitute program signals transmitted by 
the central station equipment 10 are received by a tuner 60, or in the case of a digital 
transmission a program selector 70 which may include a tuner, at the viewer station 
15 equipment 20. Figures 5 and 6 show exemplary analog Viewer station equipment 22 
and digital viewer station equipment 24, respectively. In the analog viewer station 
equipment 22 a conventional tuner SO is provided for tuning to a desired channel 
frequency, while the digital viewer station 24 may also include a program selector 60, 
as more than one channel may be received on a single frequency. A viewing control 
20 unit 100 is provided to allow a viewer to select a desired program signal for viewing. 
Control of the tuner 50 or program selector 60/ and thus selection of a particular 
carrier frequency or program, may be accomplished in a conventional manner by a 
remote control device or by a control knob on the viewing control unit 100. 

The appropriate received signals are then supplied by the tuner 50 or program , 
25 selector 60 to a conventional demodulator 80 in the analog viewer station equipment 
22 or a conventional demodulator 80 and decoder 90 in the digital viewer station 
equipment 24. The demodulator/decoder 80/90 of the digital viewer station 
equipment demodulates and decodes the program signals to supply the digital audio, 
digital substitute audio, digital video, and digital substitute video signals to a digital 
30 access control unit 124. The demodulator 80 of the analog viewer station equipment 
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22 demodulates the programs signals to supply analog signals to an . analog access 
control unit 122. 

The video signal also contains the transmitted information label TIL and other 
labels in addition to video information. , The transmitted labels are sent to the label 

5 interpretation unit 110 by the demodulator. The label interpretation unit 110 detects 
the information label TIL in the received video signal as well as other codes such as 
scramble codes, if appropriate. , , ^ 

The viewing control unit 100, in addition to providing a signal instructing the 
tuner SO or channel selector 60 as to which program to select, also includes a local 

10 information label generator 270, as shown in Figure 7, for generating a local 

information label LIL to control access to the selected program signals. Hie local 
information label LIL includes local category labels which are preferably analogous in 
format to the transmitted category labels in the. admitted information label TIL 
. _ shown in Figure 3 . For example, the local information label LIL, may include an 

15 audio category label and video category label which, are analogous to, the audio and 
video category labels in the TIL. Or, the LIL may include a video violence content 
label which is analogous to the video violence content label of the TIL. The local 
category labels are set by the user and can define the type apd extent of access to the 
received program signals. 

20 As with the transmitted category labels, the different values of the local 

category labels such as 1, 2, 3, and 4 can represent classifications of the content of 
the audio and video portions of the programs such as "G w , w PG n , W R H , and "NC-n", 
respectively. As with the transmitted category labels in the TIL, additional local 
category labels can also be included in the LIL, such as for, audio violence, audio 

25 sexual content, video violence, video sexual content, and foul language. Local 

category labels specifying acceptable types of stories, acceptable values, acceptable 
data, or any other desired category, can also be generated and set independently. 
Thus, a user who considers violence, but not sexual program material, offensive, can 
set the local audio and video violence category labels at a low yiolence rating such as 

30 H AV-2* and M VV-2 M and can set the local audio and video category labels for sexual 
content at a higher rating, such as "AS-6" and W VS-6 M . Moreover, the audio and 
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video category labels can be set independently so that a user who is more offended by 
violent video than violent audio may set the local video violence category label higher 
than the local audio violence category label. Of course, the number and type of 
categories may be designed as desired, so that various embodiments of the invention 
5 can provide enormous flexibility in shaping the type of information which is 

accessible to a user. The local information label generator 270 combines the local 
category labels set by the user into a local information label LIL which is transmitted 
to the label interpretation unit 110. : 

The locid information label generator 270 can generate a "16^ 

10 label" which is analogous to the transmitted rating profile label in the TIL. As 

described above, the transmitted rating profile label may contain information as to the 
percentage of time during a program that the overall program signal or individual 
program signals are rated at a certain level such as "PG" or "RV The local rating 
profile label preferably contains a suitable number of bits which allow a viewer to 

15 specify a maximum allowable percentage of time during a program that the program 
can be rated above a locally specified rating, su6h as "PG\ The local rating profile 
label can also be configured to specify a maximum allowable percentage of time 
during a program that the individual program signals can be rated above a locally 
specified rating, such as AV-6, W-7, AS-4, VS-3, or L-2. In this way, the viewer 

20 can limit with particularity the amount of objectionable or undesirable material in the 
program signals. 

If a program contains more than the predetermined amount of objectionable 
material, the viewer may wish to deny access to the program completely, rather than 
view the program with numerous interruptions. The local rating profile label thus 

25 preferably includes a "full/partial blocking- label which allows a user to choose 
between viewing the program with interruptions (partial blocking) no matter how 
many, or blocking the program entirely if the percentage of the program containing 
offensive material is greater than the specified percentage (full blocking). For 
example, if 25 percent of the transmitted audio signal is rated above the locally 

30 chosen rating of "G H , the user may choose with the "full/partial blocking" label to 
deny access to the program completely, rather than view the program with significant 
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interruptions to the audio signal. The viewer may thus input to the viewing control 
unit 100 via remote control the various tolerable percentages for each local category, 
e.g., overall program, audio, and video, and the value of the full/partial blocking 
label. If the user specifies in the local rating profile label, for example, that the 

5 maximum allowable time percentage above the "G" rating for the overall program is 
25 percent and chooses tip "full blocking" option, ^nd the transmitted rating profile 
label in the TIL indicates that 27 percent of the transmitted information is rated higher 
than "G", the program will be blocked in its entirety. This feature enables a user to 
avoid the situation in which a program is frequently interrupted. Alternatively, the 

10 user may set the ** full/ partial blocking" label on "partial" so that the program is 

viewed but with interruptions. As will be described in greater detail below, blocking 
can be implemented, by a. variety of methods, such as not tuning to the requested 
channel, not descrambling the requested channel if it is scrambled, tuning to an 
alternative channel, or displaying an information screen and no audio instead of the 

15 requested channel picture and audio. :; . 4 ,,, ^ ^ T: ^ ; i - 

As shown in Figure 7, the viewing control unit 1QQ may include a controller 
280 which controls the generation of the local information label LI]U Th e viewing 
control unit 100 may also include plurality of category registers 290 for storing the 
local information label settings, e.g., the values selected by the viewer for the local 

20 audio, video, and rating profile labels. A register 300 may also be provided to store 
a locked channel list. The locked channel list 300 is accessible to the controller 280, 
which can deny access to any channels in the locked channel list 300 by sending the 
appropriate frequency control signals to the tuner 50 or program selector 60. A 
viewer would typically include in the locked channel list channels which contain a 

25 large amount of objectionable material,, such as a sexually explicit channel or a horror 
movie channel. 

The viewing control unit 100 can be used to supervise the content of incoming 
program signals and thus preferably includes a lock mechanism 310 for preventing the 
local information label LIL from being changed except with a personal identification 
30 number (PIN) or combination or physical key. According to one embodiment, the 

viewing control unit 100 includes aTnempry 3?0 for storing a master combination and 
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an operating combination. The operating combination can be keyed in by a parent 
with a keypad 330 or remote control device to change the local audio and video 
category labels, for example. A comparator 340 in the viewing control unit 100 
compares the operating combination stored in the memory 320 with the combination 

5 entered via the keypad 330, and if they are equal, enables the local information label 
LIL to be changed. Knowledge of the master combination allows a user to change the 
operating combination stored in the memory 320. The master combination can be 
kept in a safe place by parents so that it can be used to change the operating 
combination in the event that the operating combination is lost. 

10 According to another exemplary method, the master combination can be 

retained by the manufacturer, and the operating combination can be changed by 
knowledge of the operating combination. Initially, the operating combination can be 
set to 0000, for example. If the operating combination is forgotten, parents may call 
the manufacturer who can provide instructions as to how to reset the operating 

15 combination to 0000. In order to maintain the security of the reset procedure, the key 
strokes necessary to reset the operating combination to 0000 preferably change each 
time the master combination is reset. 

According to a further embodiment, the lock mechanism 310 can be a physical 
lock and key, for example made of metal or plastic. By inserting the key into the 

20 lock, parents can reset the operating combination to 0000. 

The lock mechanism 310 thus preferably allows a user to change or input the 
local information label LIL only after entering the appropriate combination or PIN via 
the remote control. After keying in the correct PIN, the user, according to an 
exemplary embodiment next presses a specified button on the remote control to access 

25 the audio category labels, and increments or decrements the values with the audio 

volume control buttons, for example. The video category labels may be accessed with 
a different button and changed, for example, with the channel selector on the remote 
control. Other labels may be accessed and changed in a similar manner. 

A memory 350, which may be a non-volatile memory, can be included in the 

30 viewing control unit 100 which contains default settings for the local information label 
LIL and locked channel list. The manufacturer may set default settings which may be 
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reset by users and which would control access to the program signals after a power 
outage or before the user has stored the desired local labels in the viewing control unit 
registers 290 and 300. The default settings may be reset by a user with a remote 
control in a manner similar to the setting of the local information label LIL. The user 

5 may input default settings which are stored in the memory 350. The memory 350 
preferably includes registers to store default settings for different times during a day. 
For example, the user may input a first group of default settings which are higher in 
the daytime hours when children are in school, lower in the late afternoon and 
evening when children watch TV, arid higher again in the late evening when the 

10 children are asleep. The controller 280 may include a timer for determining when 
each set of default settings is active. As with the manufacturer-provided default 
J settings, the user programmed default settings are preferably overridden by the local 
category labels. The controller 280 may be programmed to first look to the local user 
programmed labels, and if they are not available, to the default settings. The default 

15 labels or the user programmed labels stored in the registers 2SK) are output to the local 
information label generator 270 which (generates the local information label LIL for 
transmission to the label interpretation unit 1 10. 

The viewing control unit 100, if implemented with a billing system, may 
include additional controls to provide appropriate signals which indicate that the 

20 viewer has selected a program for viewing and has thus assumed the obligation to pay 
for that program. An example of such a billing system is provided in the above 
referenced U.S. Patent No. 4,528,589. 

Referring back to Figures 5 and 6, the local information label LIL generated 
by the viewing control unit 100 is transmitted to a label interpretation unit 110, which 

25 also receives the instantaneous transmitted category labels in the transmitted 

information label TIL for the program being viewed from the video signal output 
from the demodulator. As shown in detail in Figure 8, the label interpretation unit 
110 may include a comparator 370 which compares the transmitted information label 
TIL with tiie local information label LIL generated by the viewing control unit 100. 

30 The comparator 370 compares the locally generated audio arid video category labels, 
for example, with the transmitted audio and video category labels, and generates a 
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signal indicating whether the transmitted category labels are greater than the local 
category labels, in which case the program signals are blocked or modified. 

The label information processor 380 receives the various category labels from 
the TIL and LlL and access processing instructions from the TIL as well as the output 
5 from the comparator 370 and generates appropriate audio and video access control 
signals 390 and 400* The comparator 370 looks at the received TIL data and 
compares it with the LIL data. In cases where the data fields of the TIL exceed the 
setting of the LIL, the TIL is output to the label information processor 380. The label 
information processor 380 extracts from the data structure the audio and video access 
10 control signals. These are then passed to the access control unit 120. 

By way of example, if the local foul language label is set at 3, and the 
transmitted foul 'language label is 2 , the label interpretation unit 110 will generate an 
audio access control signal 390 which instructs the access control unit 120 to allow 
the audio program signal to be transmitted the viewer. If the local video sexual 
15 content label is set at 2, and the transmitted video sexual content label is 3, the label 
interpretation unit 1 10 will generate a video access control signal 400 which instructs 
the access control unit 120 to modify or block the video signal before transmission to 
the viewer. The label interpretation unit 1 10, according to an exemplary 
embodiment, may thus allow the user to access program signals which are labeled 
20 with a transmitted category label which is less than or equal to the corresponding local 
category label. Access decisions such as this are preferably controlled with the audio 
and video access processing instructions in the TIL. 

An exemplary analog access control unit 122 is shown in Figure 9, and an 
exemplary digital access control unit 124 is shown in Figure 10. The access control 
25 unit receives audio and video access control signals 390 and 400 from the label 

interpretation unit 1 10 and uses these signals to control access to the audio and video 
program signals and substitute signals received from the demodulator with an audio 
access control signal processor 460 and a video access control signal processor 480. 
The audio and video access control signals 390 and 400 preferably include access 
30 instructions for the access control unit 120. The audio and video access control 

signals 390 and 400 are generated in the label interpretation unit 1 10 in accordance 
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with the audio and video access processing instructions contained in the transmitted 
information label TIL. The audio access control signal processor 460 preferably 
includes an audio access synchronization unit to synchronize the switch 410 according 
to the timing of the video signal and instructions in the audio access control signal 
5 390. A switch 420 is provided to control access to the video signals. 

The audio access control signal processor 460 examines the audio access 
control signal 390 received : from the label information processor 380 and interprets 
the instructions contained in the audio opcode of the, TDL. For example, the audio 
access control signal processor 460 may be instructed by the audio access control 

10 signal 390 to bleep out a word with tone of 1000 Hz starting at line 200 for 15000 
lines. The audio access control signal processor 460 would then carry put this 
function as required. Similarly tjie video access control signal processor 480 
interprets the video access control signal 400 and performs the instructions contained 
in the video opcode of the TIL, e.g., rectangular mask, from pixel 20,100 to 300,125. 

15 According to one embodiment, the audio and video access control signals 390 

and 400 instruct the audio and video access control signal processors 460 and 480 of 
the access control unit 120 to block transmission of the audio or video program 
signals when the transmitted category label exceeds the local category label. Thus, as 
shown in Figures 9 and 10, switches 410 and 420 are provided in the access control 

20 unit which are opened and closed in accordance with the audio and video access 
control signals 390 and 400 received from the label interpretation unit 1 10. The 
access control unit thus controls access to the audio and video program signals based 
on a comparison of the transmitted information label TIL and the local information 
label LIL. For example, if only the video category label is acceptable, as defined in 

25 the local information label LIL, the video portion of the program, but not the audio 
portion, is enabled so that the viewer is presented with only the video portion of the 
program. The audio and video category labels can thus be used to independently limit 
access by the viewer to the received audio and video program signals. The audio and 
video category labels can change with any frame, so that enabling of either signal is 

30 carried out at different times during the program depending on the transmitted audio 
and video category labels. 
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Because the received video signal preferably contains audio and video category 
labels in each vertical retrace interval or at an appropriate location in a digital video 
stream, the invention provides for the denial of access to only selected portions of a 
program. For example, in a program containing only a small amount of objectionable 

5 audio content/ access can be denied only as to the objectionable audio content while 
access to the remainder of the program is allowed. In this way, only the 
objectionable material is blocked/ rather than the entire program being blocked. The 
invention also allows for the resumption of the presentation of audio and video signals 
during the program to the viewer after the offensive or undesirable material has been 

10 blocked, because the label interpretation unit 110 can continually monitor die 

transmitted audio and video category labels. Of course, the other types of category 
labels, such as the audio violence, video sexual content, or data category labels can be 
used in the same way to control access to the 1 program signals. 

Referring again to Figures 5 and 6, the access controlled audio and video 

15 signals can be output to a conventional modulator 130. The modulator 130 modulates 
a carrier signal of an appropriate carrier frequency with the audio arid video signals 
and supplies the program signals in the form' of a modulated carrier wave to the 
television antenna terminals for use by the viewer's television set in a conventional 
manner. Alternately, the access controlled audio and video signals may be 

20 transmitted directly without modulation. 

In some circumstances, a user may desire to deny access to a particular 
channel on a long-term basis. This may be accomplished with the register 300 in the 
viewing control unit 100 which comprises a locked channel list. As with the local 
category labels, the locked channel list 300 may be set or changed by a 'user after 

25 entering the correct PIN. The controller 280 may access the locked channel list 300 
and instruct the tuner 50 or program selector 60 not to tune or select any channels 
listed in the locked channel list 300. In an analog system, frequency denial may be 
implemented by programming the tuner (synthesizer) 50 to not tune selected 
frequencies. This technique may be advantageously used to block ah entire channel 

30 for an extended period of time, for example a horror movie channel. In a digital 
environment, the controller 280 of the viewing control unit 100 sends appropriate 
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instructions to the program selector 60 to avoid a particular time slot in the case of 
time division multiplexing (TDM) or a particular code in code division multiple access 
(CDMA). . •,...<,,.-,;. 

According to further embodiments of the invention, various substituted audio 

5 and video signals can be provided to the; viewer when the content of the transmitted 
audio and. video signals is offensive or undesirable, as defined by the Jocal 
information label LEL, As will be described ip greater ^e^ ^elow, these substituted 
audio and video signals can either be generated locally in the viewer station equipment 
20 or generated at the central station equipment 10 and transmitted to the viewer 

10 station equipment 20, : 

According to one embodiment as shown in Figures 9, and L0, the access 
control unit 120 can include conventional hardware for generating substituted audio 
signals which are output to the modulator l^ in place of the received audio signals 
when the transmitted audio category label in the tnmsnutted infonna label TIL 

15 exceeds thie acceptable audio categoi7 labd as defined by, ^ 

label in the local information label UL. In Figures 9 an d 10 , ^n audio signal 
generator 450 is provided in the access control units. The audio signal generator 450 
can be activated by the label. interpretation unit 110 via the audio access control signal 
390 through the switch 410 to output a suitable signal such as a tone signal when the 

20 transmitted audio category label exceeds the local audio category label. Thus, for 
example, obscene language can be "bleeped" put at appropriate times with the audio 
signal generator 450. 

A conventional character generator 470 can be activated by the label 
interpretation unit 110 through the switch 420 when the transmitted video category 

25 label exceeds the local video category label. The character generator 470 can output a 
signal containing an appropriate message to be displayed on the viewer's TV screen as 
a substitute for offensive portions of the video signal. A signal representing the 
displayed characters can be specified in the audio and video access processing 
instructions of the transmitted information label TIL and can be sent to the character 

30 generator 470 via the video access control , signal processing unit 480 on a line 485. 
The character generator 470 can $l$o output, for, example, a signal, representing a 
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standard slide or picture, which has been pre-stored in a memory of the character 
generator, to be displayed during offensive portions of the received video signal. 

According to a further embodiment of the invention as shown in Figures 9 and 
10, the access control unit includes a frame storing unit 490 for allowing a "freeze 
5 frame" function. The frame storing unit 490, as shown in greater detail in Figure 11, 
includes a video memory 500, and in the case of an analog system, an analog to 
digital converter (ADC) 510 and a digital to analog converter (DAC) 520. In a digital 
system, the ADC and DAC are replaced with digital video interface units. The video 
memory 500, in conjunction with an input address generator 535 and a timing unit 
10 555, stores the video signal as it is received. During an offensive scene, in 
accordance with the video access processing instructions of the TIL, when the 
transmitted video category label exceeds the local video category label, a freeze frame 
signal 530 may be sent by the video access control signal processor 480 to the input 
address generator 535 so that subsequently received video signals are not stored in the 
15 video memory 500. The label interpretation unit 1 10 also instructs the switch 420 to 
connect to the frame storing unit 490 which contains the last scene prior to the 
offensive scene. The video frame stored in the video memory 500 of the frame 
storing unit 490 is then refreshed on the video screen continuously as the output 
address generator 545 continues to generate output addresses for the data stored in the 
20 video memory 500. The frame storing unit 490 supplies the video signal to the 

modulator 130 for the duration of the offensive video signal. Therefore, the same 
still picture is seen by the viewer until a new video frame is supplied via the switch 
420. In this way, the last scene is "frozen- when objectionable material is received. 
As will be appreciated by those skilled in the art, the "freeze frame" technique is used 
25 extensively, for example, in standard time base correctors (TBCs). 

According to another embodiment, the program labeling station 30 in the 
central station equipment 10 includes a mask code generator 180 which generates a 
mask code signal defining a mask to be laid over offensive portions of a video screen. 
The mask can be in the shape of a circle, square, rectangle, or any other suitable 
30 shape. The mask code generator 180 generates a mask code signal defining the shape 
of the mask, the size of the mask, the coordinates of the mask on the TV screen at 
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different points in time, and any other pertinent data. The coordinates and shape of 
the mask can be specified, for example, with the parameters contained in the video 
access processing instructions of the TIL, as shown in Table 1. 

In the viewer station equipment 20, the label interpretation unit 110 determines 
5 whether the transmitted video category label exceeds the allowable video category 
label as defined by the local video category label. If the transmitted video category 
label is acceptable, the video signal is passed to the modulator 130 unaltered. 
However, if the transmitted video category label exceeds the local video category 
label, the label interpretation unit 110 transmits an appropriate video access control 

10 signal 400 instructing the video access control signal processing unit 480 in the access 
control unit 120 to command a local mask generator 540 to insert the mask defined by 
the mask code signal of the TIL into the video signal before passing the video signal 
to the modulator 130. The local mask generator 540 generates mask data and a mask 
address which are sent to the video memory 500 in the frame storing unit 490 as 

15 shown in Figure 11. In this way, only certain portions of a screen are blacked out, as 
opposed to the entire screen. For example, as shown in Figure 1 1 , a mask can be 
defined by the mask code generator 180 and transmitted in the TIL which blocks a 
portion of an image on a screen and moves with the image through the scene. 

The local mask generator 540 may also be adapted to produce a blurring effect 

20 mask instead of a blacked out mask. As shown in Figure 1 1 , data from the video 
memory 500 may be sent to the local mask generator 540 which averages the video 
data and sends the averaged data back to the video memory 500, rather than sending a 
signal representing a blacked-out mask. The averaging of the video data produces a 
blurring effect which may be more aesthetically pleasing to a viewer than a blacked- 

25 out portion. 

According to further embodiments of the invention, substituted audio, and/or 
video, and/or data signals can be transmitted to the viewer station equipment 20 from 
the central station equipment 10 which, for example, replace the entire normal audio, 
video, and data signals or portions thereof. For example, as described in U.S. Patent 
30 No. 4,410,911, entitled "Multiple Signal Transmission Method and System, 

Particularly for Television w , which is hereby incorporated by reference, a plurality of 
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audio signals other than the normal audio signal can be provided in the composite 
television signal within the portion of the band allocated to audio transmission. 
Commonly known as a Separate Audio Program (SAP), these other audio signals are 
displaced in carrier frequency from the normal audio signal carrier frequency, but the 
S composite audio is within the 200-250 KHz band allotted for audio transmission in the 
frequency band of a single television channel. Figure 12 shows one example of a 
method for transmitting substitute audio signals which may be implemented in an 
analog environment. The audio signals shown in Figure 12 may include, for 
example, a regular audio signal 550, an alternative language audio signal 560, and a 
10 substitute audio signal 570. As described in the above referenced U.S. Patent No. 
4,410,911, a conventional audio selector may be provided, for example in the 
demodulator/decoder unit 80/90 of the viewer station equipment 20, for recovering 
the individual audio signals.. The access control unit 120 of the viewer station 20 also 
includes a switch 410, synchronized with the video signal and the audio access control 
15 signal 390, for switching in the substitute audio signal at the appropriate times. For 
example, in accordance with the transmitted audio category label and the audio access 
processing instructions of the TIL, the substitute audio signal can be switched in as 
the access controlled audio signal when the transmitted audio category label exceeds 
the locally generated audio category label. 
20 In this embodiment, the transmitted information label TIL preferably includes 

an additional audio category label for each substitute audio signal. Thus, the 
information label generator 170 will generate an audio category label for each audio 
signal being transmitted. The transmitted information label TIL may also include 
audio access processing instructions which identify the locations of the additional 
25 audio signals in the transmitted information signal and which instruct the access 
control unit 120 to transmit to the viewer the audio signal having the highest 
acceptable rating, for example. 

In the viewer station equipment 20, the label interpretation unit 110 compares 
the transmitted audio category label with the locally generated audio category label, 
30 and instructs the switch 410 to select the audio signal having the highest audio 

category label which does not exceed the locally generated audio category label. The 
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switch 410 may thus include as many contacts as appropriate for the number of 
substitute audio signals. The selected audio signal is then transmitted to the 
modulator 130. 

According to further embodiments of the invention, a substituted audio signal 

S can be inserted into the video signal. A substitute audio signal can be compressed and 
inserted, for example, into the vertical retrace interval of an analog video signal along 
with the transmitted information label TEL, or in a digital system, in any appropriate 
location in the digital video stream . Thus, the signal combiner 260 of die central 
station equipment 10 receives the substitute audio signal and inserts the substitute 

10 audio signal into the video signal in a conventional manner. Ah additional audio 
category label which defines the content of the substitute audio signal, and audio 
access processing instructions defining the location of the substitute audio signal 
within the video signal, are also generated by the information label generator 170 and 
inserted into the video signal within the information label TIL. The substitute audio 

IS signal in the vertical retrace interval can be extracted from the video signal by the 
data receiver 85, decompressed, and stored for playback at the appropriate time, in 
accordance with the audio access processing instructions. Alternatively in a digital 
implementation the substitute audio is demultiplexed from the data stream. 

According to a further embodiment of the invention, an additional audio signal 

20 is generated by the substitute source ISO and transmitted to an encoder 1SS as shown 
in Figure 13, which inserts the additional audio signal in place of one or more of the 
standard 525 lines of the video signal. For example, as described in U.S. Patent No. 
5,130,815, entitled "Method and Apparatus for Encoding a Video Signal Having 
Multi-Language Capabilities", which is hereby incorporated by reference, a pre- 

25 selected number of scan lines located at the top or bottom portion of the video picture 
can be used to store audio information* One or more scan lines can be dedicated to 
each substitute audio channel. As shown in Figure 13, the encoder 155 is provided to 
insert the substitute audio signal into the top or bottom scan lines of the video signal 
at the appropriate time. The modified video signal output from the encoder 155 can 

30 be an NTSC compatible signal containing time division multiplexed audio channels. 
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The modified video signal is transmitted to the viewer station equipment 20 where the 
audio signals are recovered using a decoder 165. 

The decoder 165 recovers the substitute audio signal by sending the modified 
video signal at the appropriate time to an analog to digital converter in the decoder 

5 165 which converts the substitute audio signal to a digital format. The digital 
substitute audio is subsequently stored and then converted into analog format after 
which it is transmitted to the viewer. Hie decoder 165 may also include a line 
blanking device to insert a null signal into those portions of the video signal where the 
audio information has been overwritten. When the video picture is displayed, this 

10 portion of the signal will appear to be a black line. 

The information label generator 170 in the central station equipment 10 
preferably generates an audio category label for each substitute audio signal, and the 
labels are received by the label interpretation unit 1 10. The information label 
generator 170 also generates appropriate access processing instructions which identify 

15 the location of the, substitute audio signals within the video lines so that the substitute 
audio signals can be recovered. The label interpretation unit 1 10 instructs the access 
control unit 120 to transmit to the modulator 130 the audio signal having, for 
example, the greatest acceptable audio category label, as defined by the locally 
generated audio category label. 

20 As will be appreciated by those skilled in the art, various interpolation 

techniques have been devised which allow for a reconstruction of the video signal 
using less than all of its 525 lines. Such interpolation techniques are useful, for 
example when the transmission of addition information requires more lines of video 
than those at the top or bottom portions of the video picture, as described above. The 

25 lines in the video signal which are replaced by the additional audio signal may then be 
reconstructed using known methods of line interpolation. For example, in accordance 
with appropriate instructions provided by the video access processing instructions of 
the TIL, the frame storing unit 490 of the access, control unit 120 can be used for 
interpolation to replace a missing line of video. As shown in Figure 11, an 

30 interpolation unit 495 can be provided to read two lines of the video signal adjacent to 
the missing line, calculate an average, brightness and color of adjacent elements in the 
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two lines, and overwrite the missing line in the video memory 500 with the average 
values. 

Exemplary embodiments of the invention in which a substituted video signal is 
transmitted to the viewer station equipment 20 will now be described. According to 

5 one embodiment, a first video signal occupies the odd-numbered lines in the 525-line 
video signal, and a second video signal occupies the even-numbered lines in the 525- 
line video signal. Through kno above, either 
one of the video signals- can be reconstructed for presentation to the viewer. The 
video access processing instructions in the TIL may thus" contain appropriate 

10 instructions which direct the access control unit 120 to transmit the interpolated even 
or odd lines of the video signal. The video access processing instructions may be 
used for example to control the frame istoring- unit 490 to store in the video memory 
~ 500 the even lines of the video signal and ait interpolation of the even lines of the 
video signal in place of the odd lines of the video signal. v The interpolation may be 

15 accomplished in a conventional manner by averaging, the color and intensity values of 
adjacent elements between even numbered lines. The interpolation unit 495 reads the 
even numbered lines in the video memory, calculates an average color and brightness 
value between elements in adjacent even-numbered lines, and writes the calculated 
average value over the existing odd-numbered line. The program code generator 170 

20 in the central station equipment 10 generates an appropriate video category code for 
each video signal, so that the code interpretation unit 110 can instruct the access 
control unit 120 as to which video signal to interpolate and transmit. 

According to a further embodiment, one or more dedicated channels are 
provided for transmitting a substitute video signal. As shown in Figure 14, a 

25 substitute video stream may be provided which contains substitute video signals for 
one or more programs. In Figure 14, the substitute video stream contains substitute 
video signals for program video streams A and B. In an analog environment, the 
substitute video stream is ordinarily provided on an additional frequency channel. In 
a digital system, the substitute video stream is preferably transmitted in a different 

30 time slot on the same frequency as the program video stream or streams, so that no 
frequency switching is necessary. However, it is of course possible to transmit the 
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substitute video stream in a digital system on a different frequency* The substitute 
video stream preferably contains substitute video signals for an appropriate number of 
program signals such that no two of the program video streams A or B require 
substitute video signals simultaneously. 
S As shown in Figure 5, to access the substitute video stream in an analog 

system, the access control unit 122, following the video access control signals from 
the label ih^rprektion unit 110, sends a substitution frequency change request to the 
viewing control unit 100, which instructs the tuner 50 via a frequency control signal 
to tune to die frequency of the substitute video stream. The substitute video stream is 
10 then transmitted to the viewer. Hie substitute video stream is preferably part of an 
entire television channel including an audio signal and appropriate program labels. In 
this way, the program labels of the substitute signal are used to direct the tuner SO to 
tune to the regular program channel when the required substitution has ended. 

The "substitution may occur when, according to the video access processing 
15 instructions, the transmitted video category label exceeds the local video category 

label. Hie substitute video stream is preferably rated at the lowest rating such as "G° 
so that only one substitute video stream is necessary. However, it is of course 
possible to provide many substitute video streams at different ratings such as "PC 
and "R** so that the substitute video signal will be rated as high as possible without 
20 exceeding the rating specified in the local video category label. 

In a digital television system, the video signal may be transmitted in a time 
slot within a time frame using conventional Time Division Multiplexing (TDM) or 
Time Division Multiple Access (TDMA) techniques, for example!! Thus, the 
substitute video signal preferably resides within a second time slot on the same 
25 frequency channel, so that it is not necessary to tune to a different frequency channel 
to obtain the' substituted video signal. As shown in Figure 10, the video access 
control signal processor 480, as directed by the video access processing instructions, 
sends a substitute video time slot change request to the de-multiplexer 465 which 
accordingly transmits the appropriate time slot as the digital video stream. The 
30 substitute video stream may be processed in the frame storing unit 490 with the 
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substitute video memory 565, which includes an appropriate timing unit and address 
generator, not shown in Figure 11 for simplicity. 

In either the analog or the digital system, the transmitted information label TIL 
preferably includes an additional video category label for the substitute video signal, 

5 as well as information which identifies the time slot in which, the substitute video 
signal is located. The label interpretation unit 110 may direct the access control unit 
120 to transmit to the viewer the video signal having the highest acceptable video 
category label as defined by the local video category label. 

According to a further embodiment of the invention, substitute audio and video 

10 signals can be transmitted in the unused spectrum of the transmitted program signal. 
It is well known that less bandwidth is used during some portions of a transmission 
than during other portions of the transmission* For example, in digital transmissions, 
less bandwidth is used to transmit dark scenes than bright ones and less bandwidth is 
used to transmit voice than music. As will be appreciated by those skilled in the art, 

15 currently available compressed digital technology can put enough data for 10 or more , 
channels in the bandwidth used for a single analog TV channel. The excess capacity 
of these systems may be used to transmit substitute audio or video signals 
synchronously with the original material or in advance to be stored at the user 
location in a substitute video memory 565 and clocked out of the substitute video 

20 memory 565 memory at the appropriate time as substitute audio and/or video. 

Those skilled in the art will appreciate that, in addition to time division 
multiplexing, many other well known transmission techniques may be implemented in 
conjunction with the present invention to transmit and recover the program signals and 
substitute program signals. For example, Direct Sequence Spread Spectrum uses 

25 codes to separate information, and Frequency Hopping Spread Spectrum uses an 
instantaneous frequency location which is continuously changing to differentiate 
between information signals. Several spatial means of differentiating signals are also 
known in the art. Thus, the substitute program signals may be sent from different 
locations (space diversity) or with different polarities and later separated based on the 

30 transmission method. For example, the substitute program signal can be transmitted 
on the same frequency as the regular program signal, but at a different antenna 
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polarity. As will be appreciated by those skilled in the art, satellite transmissions 
often use horizontal and vertical polarity to permit the transmission of two signals on 
the same frequency. According to another embodiment, die substitute signals are 
transmitted on the same frequency but at another phase. Quadrature phase 
5 modulation /for example, provides two signals on the same frequency but the phase of 
one is 90 degrees to the other. These signals can be detected separately. Various 
known data compression methods can also be used to compress the program signal 
and the substitute program signal so that they both can be transmitted in the space 
allocated for the program signal. Time spreading techniques, also known as Spread 
10 Time Code Division Multiple Access, and as described in U.S. Patent No. 5,101,432, 
entitled "Signal Encryption,* which is hereby incorporated by reference, can be used 
for transmission and recovery of the program signals and substitute program signals. 
All of the above mentioned techniques can be implemented in conjunction with the 
present invention to send and recover the program signals and substitute program 
15 signals, as will be appreciated by those skilled in the art: : 

From the foregoing description, it will be apparent that exemplary 
embodiments of the invention provide the user with a great degree of control over the 
extent and type of information which may be accessed! With the transmission of 
substitute audio and video signals the user may also tailor received program signals to 
20 his or her individual tastes. A particularly suitable application for the present 

invention is with movies which have been produced in different versions. Motion 
picture producers frequently cut movies differently depending on the culture of the 
viewing audience. For example, movies are cut differently for US theatrical release, 
network television, Pay-TV, and airlines, as well as for European, Far East, Middle 
25 East, and Latin American markets. With the present invention, a user may select a 
particular film and control the content or version of the film based oh the local 
category labels. Thus, the viewers benefit with the capability of making informed 
choices based on the transmitted category labels in the TIL, and the producers and 
distributors gain by having a greater opportunity to provide what customers want. 
30 Although the present invention has been described primarily in the context of 

television and movies, it should be understood that the invention can be implemented 
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in any system in which a program is delivered to a viewer. Electronic books, for 
example, in which words are displayed on a screen or projected through a speaker 
present another advantageous application. A substitute prpgram signal may be 
, provided which comprises an alternate portion of a dialog. Stories can thus be 

5 tailored to the preferences of a particular user with the local category labels which are 
set with a suitable control .unit. Instructional programs <^uU>e appropriately presented 
to a pupil based on ex^rienc^-level using th? local calory Jabels. . Program signals 
comprising data or data files, may be labeled, substituted, and controlled using the LIL 
and the TIL or other appropriate labels and control units. t . . , 

10 Musical recordings are another example of an application for the present 

invention. Songs which contain offensive lyrics may thus be recorded: in different 
. versions and labeled accordingly. The listener using an appropriate control unit can 
input local audio category labels so that offensive lyrics will be blocked or substituted 
with acceptable lyrics. The substitute lyrics can be stored on the same medium as the 

15 program signal, . such as a single compact disc, so as to be easily accessible. In an 
embodiment in which the program labels are not transmitted by cable or broadcast 
techniques, but rather reside on a single storage medium with the program signal, the 
label may be more appropriately referred to as a "program information label" PIL 
rather than a transmitted information label TIL. 

20 Other types of hardware may also be implemented in conjunction with the 

present invention. For example, the program, including all substitute signals, may be 
stored on a single CD ROM, video disk, video tape, audio tape, or video game 
cartridge. The user may designate appropriate local information labels which control 
access to the information contained in the storage device. Exemplary embodiments of 

25 the invention thus allow information producers to provide; more useful products to 
consumers and allow consumers a great degree of protection and control over 
information products. 

According to further embodiments of the invention, the local information label 
LIL can be used to control the transmission of program signals from a central station. 

30 As shown in Figure 1, the system may include; a communication link 15, such as a 
telephone line, a line in a two-jvay cable system, or a return path in a radio 
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communication system, by which the user can transmit the local information label LIL 
from the viewer station equipment 20 to the central station equipment 10. The central 
station equipment 10 preferably includes a label interpretation unit and an access 
control unit which process the code and program signals in a manner similar to that 
5 described above. The code interpretation unit; for example, determines whether the 
local category "codes transmitted to the central station equipment 10 are less than the 
transmitted J diteg6^ ^ signal. The user can then be advised 

* ' as to the availability of the chosen program in light of the user's local category labels. 
The customer can then decide if he/she wants to view the program and whether 
10 masking should be used. In addition, if the program has different versions, or has 
substitute audio and video signals, the particular program to be provided to the user 
can be determined by the local category labels. This embodiment may eliminate the 
need to send substitute signals to the viewer station equipment 20. It is particularly 
suited, for example, to a "video on demand" system in which each user has its own 
IS allocated channel. 

According to another aspect of the present invention, a menu of programs can 
be presented to a user in accordance with the user's individual preferences. In many 
systems, a great number of programs are available to users at a particular time. 
Because so many programs are available, it may be time-consuming for a user to 
20 browse all programs before choosing one. Accordingly, the program menu signal, 
which may be transmitted to the viewer station equipment 20 on a designated channel, 
may include for each listed program, the transmitted information label TIL of each 
program, including, for example, the transmitted rating profile label which specifies 
the percentage of time during the program that the program is rated at various ratings. 
25 In the viewer station equipment 20, the TIL is compared with the LIL. Based on this 
comparison, only programs which comply with the LIL are listed on the menu 
presented to the viewer. By way of example, a user may specify in the LIL 
"musicals" and a particular actor to obtain a menu listing all available musicals in 
which the specified actor appears. The user may also specify in the local rating 
30 profile label the tolerable percentages of time at which a program may be rated at 
specified ratings, so that non-complying programs do not appear in the menu 
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presented to the viewer. The acceptable programs are then listed on the screen and 
may be numbered sequentially 1, 2, 3, or in any other desired order, so that the user 
may select which programs to view or schedule for vie wing at a later time by entering 
the appropriate number. 

5 The above-described exemplary embodiments are intended to be illustrative in 

all respects, rather than restrictive, of the present ,iny^tipii ; ..^us A the present 
invention is capable of many variations in detailed implementation that can be derived 
from the description contained herein by a person skilled in the art, All such 
variations and modifications ; are considered to be within the scope an$I spirit of the 

10 present invention as defined by. the following claims. 
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WHAT IS CLAIMED IS: 

1. An information labeling and control system comprising: 

first means for receiving i program signal and a program information label; 

second means for generating a local information label which is related to the 
program information label; and 

third means for blocking portions of the program signal based on the program 
information label and the local information label. 

2. The information labeling and control system of claim 1, wherein the 
first means receives the program signal and the program information label from a 
central transmission station. 



IS 3. The information labeling and control system of claim 1, wherein the 

first means receives the program signal and the program information label from a 
local storage device. 

4. The information labeling and control system of claim 1, wherein the 
20 program signal is divided into frames, and each frame includes a program information 

label. 

5. The information labeling and control system of claim 1, wherein the 
program information label includes at least one of a video category label and an audio 

25 category label. 



6. The information labeling and control system of claim 5, wherein the 
video category label and the audio category label are digital signals which each 
comprise at least two bits. 
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7. The information labeling and control system of claim 1, wherein said 
portions of the program signal includes a video signal and an audio signal, and. the 
third means is adapted to independently block the audio signal and the video signal. 

8. The information labeling and control systemgf claim 1, further 
comprising means for presenting a substitute program signal yrtien said portions of the 
program signal are blocked. 4 v , ) 

9. The information labeling and control system. of claim 8, wherein the 
substitute program signal comprises at least one of a substitute audio signal and a 
substitute video signal. 

10. The information labeling and control system, of claim 8, wherein the 
substitute program signal comprises spoken words. 

11. The information labeling and control system ..of claim 1, wherein the 
third means is adapted to resume the presentation of the program signal during the 
presentation of a program. 

12. The information labeling and control system of claim 1, further 
comprising means for displaying the program information label on a video screen. 

13. The information labeling and control system of claim 1, wherein the 
program signal is a computer file comprising at least one of an audio signal, a video 
picture, and data representing text. 

14. The information labeling and control system of claim 1, further 
comprising: 

a label generator for generating the program information label; and 
a signal combiner for combining the program information label and the 
program signal. 
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15. A communication system comprising: 

a central station which transmits a program signal and a transmitted 
information label; 

a user station which receives the program signal and the transmitted 
5 information label; 

means for generating a local information label which is related to the 
transmitted information label; and 

means for blocking" portions of the program signal based on the transmitted 
information label and the local information label. 

10 

16. The communication system of claim IS, wherein the means for 
blocking is adapted to resume transmission of the program signal during the 
transmission of a program. 

15 17. The communication system of claim 15, wherein the program signal is 

divided into frames, and the transmitted information label is transmitted to the viewer 
station during each frame. 

18. The communication system of claim 15, wherein the program signal 
20 comprises at least one of an audio signal and a video signal. 

19. The communication system of claim 15, wherein the transmitted 
category signal comprises at least one of an audio category label and a video category 
label. 

25 

20. The communication system of claim 19, wherein the transmitted 
program signal comprises an audio signal and a video signal and the means for 
blocking is adapted to independently block the audio signal and the video signal based 
on the audio category label and the video category label. 
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21. The communication system of claim 15 further comprising means for 
presenting to a user a substitute program signal responsive to the local category labeL 



22. The communication system of claim 15, wherein the transmitted 
5 category label comprises a violence content label and a sexual content label. 

23. The communication system of claim 21, wherein the substitute program 
signal and the program signal are digital signals which occupy at least one of different 
time slots, different code sequences, different phases, different frequencies, different 

10 spatial locations, and different polarities. 



24. The communication system of claim 15, further comprising: 
means for selecting a local information label; and 

means for preventing the selection of the local information label from being 
15 changed, wherein the means for preventing comprises a combination lock having a 
changeable combination. 



25. The communication system of claim 15, further comprising means for 
storing a default value for the local information label. 

20 , [\ 

26. The communication system of claim 25, wherein the means for storing 
a default value is adapted to store different default values for different time periods 
during a day. 



25 27. The communication system of claim 15, wherein the transmitted 

information label includes a signal representing descriptive text which describes a 
content of the program signal. 



28. The communication system of claim 15, further comprising means for 
30 displaying the transmitted information label at the user station. 
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29. The communication system of claim IS, wherein the transmitted 
information label has at least two values and further comprises an information signal 
representing the percentage of time during a program that the transmitted information 
label is rated at each of said at least two values. 

5 

30. The communication system of claim 29, further comprising means for 
blocking an entire program signal based on said information signal. 

31. An information labeling and control method comprising the steps of: 
10 receiving a plurality of information units comprising a program signal; 

receiving a plurality of program information labels, each program information 
label being associated with a content of one of the information units; 

generating a local information label associated with a content of the program 
signal; and 

IS allowing or denying access to the information units based on the program 

information labels and the local information label. 

- 32. The method of claim 31, wherein the information units andHSie program 
information labels are received from a local storage device. 

20 

33. The method of claim 32, wherein the program signal comprises at least 
one of a video signal and an audio signal. 

34. The method of claim 31, wherein the program signal comprises a data 

25 signal. 

35. The method of claim 32, further comprising the step of displaying the 
program information labels on a video screen. 

30 36. The method of claim 32, wherein the program information labels rate a 

content of spoken words contained in the program signal. 
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37. The method of claim 32, wherein the program signal comprises musical 

lyrics. 

38. The method of claim 32, further comprising the step of presenting a 
S substitute information unit to a user. 

39. The method of claim 38, wherein the program signal and the substitute 
information umt are recorded on at least one of a compact disc, a video disc, a video 
tape, an audio tape, a computer disc, and a video game cartridge. 

10 ' *' 

40. The method of claim 38, wherein the substitute information unit 
includes a portion of a dialog. 

41. The method of claim 38, wherein the substitute information unit 
15 includes substituted musical lyrics. 

42. The method of claim 31, wherein the information units and the program 
information labels are received from a central transmission station. 

20 43. An information labeling and control method comprising the steps of: 

transmitting a program signal and a transmitted information label to a user 

station; 

generating at the user station a local information label which is related to the 
transmitted information label; and 
25 blocking portions of the program signal from being presented to a user based 

on the transmitted information label and the local information label. 

44. The method of claim 43, wherein the transmitted information label 
includes an audio category label and a video category label. 

30 
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45. The method of claim 43, wherein the program signal comprises at least 
one of an audio signal and a video signal. 

46. The method of claim 43, further comprising the step of displaying the 
S transmitted information label on a video screen. 

47. The method of claim 43, wherein the program signal is a digital signal. 

48. The method of claim 43, further comprising the step of resuming the 
10 presentation of the program signal to the viewer. 

49. The method of claim 43, wherein the transmitted information label 
includes at least one of a violence content label and a sexual content label. 

IS 50. The method of claim 44, wherein the audio category label and the video 

category label each comprise at least one of a violence category signal and a sexual 
content category signal. 

51. The method of claim 43, further comprising the step of transmitting to 
20 the viewer station a signal which includes a textual description of the content of the 

program signal. 

52. The method of claim 51, wherein said signal further includes a 
description relating the content of the program signal to the transmitted information 

25 label. 

53. The method of claim 44, wherein the audio category label and the video 
category label each have at least four values, and the method further comprises the 
step of transmitting to the viewer station an information signal which indicates a 

30 percentage of time during the program that the audio category label and the video 
category label are rated at each of said at least four values. 



WO 97/23996 



PCT/US96/20077 



-49- 

54. The method of claim 53, further comprising the step of blocking an 
entire program signal when the indicated percentage of time for a selected value of the 
audio category label or the video category label exceeds a predetermined percentage 
of time. : .: 

55. The method of claim 44, wherein the audio category label and the video 
• category labeLare digital signals which each comprise at^east two bits. 

56. The method of claim 44, further comprising the s^ep of independently 
10 varying, during the presentation of a program, the audio category label and the video 

category label according to a content of the audio signal and the video signal. 

57. The method of claim 43, wherein the program signal is divided into 
frames, and the transmitted information label is transmitted to the viewer station each 

,15 , time a ftam^of the program, signal is transmitted to the viewer station. 

58. The method of claim 45, further comprising the step of freezing a 
frame of the video signal when the video signal is blocked. 

20 59. , The method of claim 45, further comprising the slep of presenting at 

least one of a substitute audio signal and a substitute video signal to the viewer. 

60. The method of claim 59, wherein the substitute audio signal comprises 
a tone. A , 

25 

61 . The method of claim 59, further comprising the step of generating the 
substitute video signal with a character generator. 

62. The method of claim 59, wherein the substitute video, signal defines a 
30 graphic display which is presented to the viewer when the video signal is blocked. 
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63. The method of claim 59, further comprising the step of transmitting the 
substitute video signal to the viewer station. 

64. The method of claim 59, wherein the substitute video signal is 
5 generated at the viewer station. 

65. The method of claim 43, further comprising the step of masking a 
portion of a video screen. 

10 66. The method of claim 65, further comprising the step of blurring the 

masked portion of the video screen. 

67. The method of claim 66, wherein the step of blurring is carried out by 
averaging data representing a portion of the program signal. 

15 " ' * ' ^- .v - - ^ ' ' • 

68. The method of claim 45, further comprising the step of transmitting a 
substitute audio signal to the viewer station within a bandwidth of the program signal 
allocated for audio transmission. 

20 69. The method of claim 45, further comprising the step of transmitting a 

substitute audio signal to the viewer station within a vertical retrace interval of the 
video signal. 

70. The method of claim 45, further comprising the step of transmitting a 
25 substitute audio signal to the viewer station in place of a portion of the video signal 

representing a line on a television screen. 

71. The method of claim 45, further comprising the step of transmitting a 
substitute audio signal to the viewer station in a portion of a spectrum allocated for 

30 transmission of video signals. 
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72. The method of claim 45, further comprising the step of transmitting a 
substitute video signal to the viewer station on alternating lines of the video signal. 

73. The method of claim 45, further comprising the step of transmitting a 
5 substitute video signal to the viewer station on a frequency channel which is different 

from a frequency channel on which the program signal is transmitted. 

74. The method of claim 45, wherein at least one of the video signal and 
the audio signal is a digital signal, and the method further comprises the step of 

10 transmitting at least one of a substitute video signal and a substitute audio signal to the 
viewer station in at least one of a time slot, code sequence, phase, frequency, spatial 
location, and polarity which is different than that of the video signal and the audio 
signal. 

15 75. The method of claim 43, further comprising the step of presenting to 

Jhe user a menu of programs, wherein the programs appearing in the menu are 
selected responsive to the local information label. . . . * 

76. The method of claim 43, further comprising the steps of: 
20 transmitting the local information label from the user station to a central 

station; and 

selecting a program to transmit to the user station based on said local 
information label. 

25 77. A method for information labeling and control comprising the steps of: 

generating a program signal comprising a plurality of information units; 
generating a plurality of program information labels, each program information 
label being associated with at least one of the information units; 

combining the program signal with the program information labels to produce 

30 a combined signal; and 
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preventing the presentation of portions of the program signal to a user based 
on the program information labels. 

78. The method of claim 77, wherein said preventing step is carried out by 
at least one of blurring a portion of the program signal, masking a portion of the 
program signal, and presenting a substitute program signal to the user. 



WO 97/23996 



PCT/US96/20077 



1/14 



i 



1 



g 















1 


1 











I 



II s 



I 

1_ 



1 

!5 



I 



SB 






1 




is 



^ ^ 



SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT7US96/20077 



2/14 . 2 

t \ 







^5 


1 




IS 



CO 
CsJ 



.V 



sS 



<\1 
CD 




i 






SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCI7US96/20077 




SUBSTITUTE SHEET (RULE 26) 



PCI7US96/20077 



4/14 



FIG. 4 



HORIZ 
SYNC. 




EQUALIZING I SVAC 
PULSES 

VERTICAL RETRACE 



/ 



INTERVAL 



PROGRAM 
LABELS 




SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT7US96/20077 



5/14 



i 

i 



1 
S 

1 



^ 



i 



CM - 



CVI 
CNil 



^ ^ 







I 1 , 


i 




















1 










1 SUBS i 






SUBS 



s 



1 




1 



^£ » 




SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT/US96/20077 



6/14 




ro 



1 
1 

Si 



SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT/US96/20077 



7/14 



I s 

^ ^ 



il 



CNJ 



1 

2 



1 

5 



1 



1 



I 



1 

2 



I 

5 



8 
s 

I 



g 



1 

3 



s 



I 




■rO 
ro 




SUBSTITUTE SHEET, (BULE 26) 



WO 97/23996 



PCT/US96/20077 



8/14 





00 






■ : ^ 




.6 
g 




1 








i 

i 



SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT7US96/20077 



"8 



9/14 



a 



§ 
8 
g 



to 



s 

1 

s 




T 



1 



i 



8 
§ 

1 

I 



t9 

i 



i 

15 



/ 



8 



5 



I 



S 



CO 
CO 



1 

1 



2 



{ 



8 



5j 



8 
1 



SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCI7US96/20077 



10/14 



1 



«3 ^ 



8 

3 



5 



S 

8 
1 




SI 



CO 
CO 



SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT7US96/20077 



11/14 




I 

s 



) 





H 



m 



1 



ro 
to 



^ 

^ P= 



lO 

CO ' 
lO 



I s1 




SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT/US96/20077 



12/14 




SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCT/US96/20O77 



13/14 





■ CO 



LO 



I 





1 




SUB . 
AUDIO 












-1 ; 

PROGRAM 
MATERIAL 
SOURCE 




SUBSTITUTE 
AUDIO 
SOURCE 



1 




SUBSTITUTE SHEET (RULE 26) 



WO 97/23996 



PCI7US96/20077 



14/14 





SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US96/20077 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(6) :H04N 7/10. 7/14 
US CL :348 / 13. 12. 7. 10. 6. 5.5 
Accenting to International Patent Classification (IPC) or to both 



nf jV»p»i claaaification and IPC 



FIELDS SEARCHED 



Minimum documentation aeaiched (claa ai fi c a ti o n tyatcm followed by claaaification symbols) 

U.S. : 348 / 13. 12. 7. 10, 6. 5.5 



Documentation aeaiched other than minimum documentation to the extent that audi documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
APS - label, code, interactive, two-way. bidirectional, video, audio, retrace, bandwidth, alternate, substitute, 
masking, blurring - • ^. 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5,172,1 1 1 [Olivo, Jr.] 15 December 1992, col. 1, lines 
24-32, col. 2, lines 25-49, col. 3, lines 25-40, col. 4, lines 
11-51. col. 5, lines 9-35, col. 6, lines 5-59. col. 7, lines 29- 
61, col. 9, lines 25-43, and fig. 1 



US 5,387.942 [Lemelson] 07 February .1 995, col. 1, lines 1- 
52, col. 2. lines 17-57. col. 3, lines 12-40 



Y,P 



US 5,550,575 [West et al.] 27 August 1996, col. 4, lines 
48-67, col. 5. lines 1-40 



1,3, 4, 6, 8-18, 
21. 26-28, 31- 
41, 43. 45, 46, 
48. 51. 52. 56- 
66, 68-73,75- 
78 

1, 2, 5-7, 19, 
20, 22, 24-26, 
42.44, 47, 49, 
50. 55, 69, 75, 
76 

26 



fx] Further documents are listed in the coiitinuation of Box C. See patent Cunily annex. 




c, — u ^ ^, i ,„ i ,iu "T* BBter rJuuBBinaf iii^rnhrrt aaftcr the mtawmtia—l finni die or priority • 
•A' 4on,tmrwa4£fm^^t€iwnAmkbci^»Aw^k'mnMcanaiiend ptoKaph or oBCOty mdafymg^ iuKfliiPm 

to be pert of patftkxilnr n\knnmrm fho ^V"** * ceanot be 
a £* earlier flnrnurm pfrlinSnri oo or after the WaVma^wnal fiMng dote «Lo*io*roangvc^^ to involve m iovennvestep 
m LT docuo^ which mmy throw ooobto on priori* c#einl>) or whicb it **m+*4—~Mltim1f* 

^■n.Tiyfi y L rr,'!ln ' >i,,n * * n ° d>Cf " ^ *Y" d^oTp^ itk^ 

•O* ooc«nent refer™* to en ot»l di*clo*«re.. ate, cxltMoon or other oon*b.*«» wi* oneor .*« 

axmm be&nc obvm« to • penon atoilod m Che ext 

•P* oocqpoBt p*ibh»fal poor to the aUU.iaaaatinoail filing d-e bt* hrteT than ,l,i,ini< Err of fhc ammo pettntfcoMiy 




Date of the actual completion of the international search 
13 FEBRUARY 1997 


Date of mailing of the international search Tcport 

2 6 MAR W 




Name and mailing address of the ISA/US 
Commisstooer of Patent* and Trademarks 
Box PCT 

Washingtrm, D.C. 20231 
Facsimile No. (703) 305-3230 


Vlvek Snvaatava (jDy 
Telephone No. (703) 305 - 4038 





Form PCT/IS A/210 (second sheetKiuly 1992)* 



INTERNATIONAL SEARCH REPORT 



Irtteniaiional application No. 
PCT/US96/20077 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 4,225,884 [Block et al.] 30 September 1980, col. 4, lines 47- 
56 

Y,P I US 5,485,518 [Hunter et aL] 16 January 1996, col. 3, lines 38-57 

I Y,P US 5,524,195 [Oanton, ffl et al.] 04 June 1996, col. 7, lines 37- 
158, col. 8, lines 48-61 

I US 5,168,372 [Sweetser] 01 December 1992 * 



J,. ■ i 



69 

75 
76 



23, 29, 30, 53, 
54, 67, 74 



-TTO" 



Farm PCT/1S A/210 (continuation of second •hectXJuIy 1992)* 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 
□'GRAY SCALE DOCUMENTS 

Gr LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



\ 



r/l « Page 



Monk ( U 



Wo) 



